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Abstract. As a mathematical model of associative memories, the Hopfield model was now 
well-established and a lot of studies to reveal the pattern-recalling process have been done from 
various different approaches. As well-known, a single neuron is itself an uncertain, noisy unit 
with a finite unnegligible error in the input-output relation. To model the situation artificially, 
a kind of 'heat bath' that surrounds neurons is introduced. The heat bath, which is a source 
of noise, is specified by the 'temperature'. Several studies concerning the pattern-recalling 
processes of the Hopfield model governed by the Glauber-dynamics at finite temperature were 
already reported. However, we might extend the 'thermal noise' to the quantum-mechanical 
variant. In this paper, in terms of the stochastic process of quantum-mechanical Markov 
chain Monte Carlo method (the quantum MCMC), we analytically derive macroscopically 
deterministic equations of order parameters such as 'overlap' in a quantum-mechanical variant of 
the Hopfield neural networks (let us call quantum Hopfield model or quantum Hopfield networks). 
For the case in which non-extensive number p of patterns are embedded via asymmetric Hebbian 
connections, namely, p/N — >• for the number of neuron N — > oo ('far from saturation'), we 
evaluate the recalling processes for one of the built-in patterns under the influence of quantum- 
mechanical noise. 



1. Introduction 

Basic concept of associative memories in artificial neural networks was already proposed in early 
70' s by a Japanese engineer Kaoru Nakano [1J. Unfortunately, in that time, nobody interested in 
his model, however in 80's, J.J. Hopfield [21 [3] pointed out that there exists an energy function 
(Lyapunov function) in the so-called associatron (the Nakano model) and the system can be 
treated as a kind of spin glasses. After his study, a lot of researchers who were working in 
the research field of condensed matter physics picked the so-called Hopfield model up for their 
brand-new 'target materials'. 

Among these studies, a remarkable progress has been done by three theoretical physicists 
Amit, Gutfreund and Sompolinsky [3] who clearly (mathematically) defined the concept of 
storage capacity in the Hopfield model as a critical point at which system undergoes phase 
transitions from ferromagnetic retrieval to spin glass phases by utilizing the replica method. 
They also introduced a noise to prevent the network from retrieving one of the built-in patterns 
as a 'heat bath' which surrounds the neurons. They draw the phase diagram which is composed 
of three distinct phases, namely, ferromagnetic-retrieval, paramagnetic and spin glass phases. 
These phase boundaries are specified by two control parameters, namely, storage capacity and 
temperature of the heat bath. 



To evaluate the storage capacity of the Hopfield model without energy function (for instance, 
Hopfield model having a non-monotonic input-output function [5]), Shiino and Fukai [6 J proposed 
the so-called Self-Consistent Signal-to-Noise Analysis (SCSNA) which enables us to derive a 
couple of self-consistent macroscopic equations of state by making use of the concept of the 
TAP equations [3]. 

As we mentioned, these theoretical arguments are constructed for the case in which each 
neuron is surrounded by a heat bath at finite temperature. In this sense, the above studies 
revealed the robustness of the associative memories against thermal noises in the artificial brain. 

However, we might consider a different kind of such noises, that is, quantum-mechanical noise. 
As such successful attempts, Ma and Gong [7J, Nishimori and Nonomura [8] independently 
introduced the quantum-mechanical noise to the conventional Hopfield model by adding the 
transverse field to the classical Hamiltonian (from now on, we shall refer the model as quantum 
Hopfield model). Especially, Nishimori and Nonomura [8J investigated the structure of retrieval 
phase diagrams by using of the standard replica method with the assistance of the static 
approximation. Therefore, we might say that the equilibrium properties of the Hopfield model 
were now well-understood and the methodology to investigate the model was already established. 

On the other hand, theory of the dynamics to evaluate the pattern-recalling processes is 
not yet well-established. However, up to now, several powerful approaches were proposed. For 
instance, Amari and Maginu [9j pointed out that the relevant macroscopic quantities in the 
synchronous neuro-dynamics are the overlap (the direction cosine) and the noise variance. They 
derived the update equations with respect to these quantities. After their study, the so-called 
Amari-Maginu theory was improved by taking into account the correlations in the noise variances 
by Okada [TO]. 

Whereas for the asynchronous dynamics, Coolen and his co-authors established a general 
approach, so-called dynamical replica theory (TTJ [12]. They utilized two assumptions, namely, 
equipartitioning in the sub-shells and self- averaging of the intrinsic noise distribution to derive 
the deterministic flow equations for relevant macroscopic quantities. However, there is no such 
theoretical framework so far to investigate the pattern-recalling process of the quantum Hopfield 
model systematically. 

In this paper, we propose such a candidate of dynamical theory to deal with the pattern- 
recalling processes in the quantum Hopfield model. We shall consider the stochastic process of 
quantum Monte Carlo method which is applied for the quantum Hopfield model and investigate 
the quantum neuro-dynamics through the differential equations with respect to the macroscopic 
quantities such as the overlap. 

This paper is organized as follows. In the next section 2, we explain the basics of the 
conventional Hopfield model and its generic properties. Then, we categorize the model into two 
distinct classes according to the origin of noises in artificial brain. The quantum Hopfield model 
is clearly defined. In section 3, we explain the quantum Monte Carlo method based on the 
Suzuki- Trotter decomposition [13] and consider the stochastic process in order to investigate 
the pattern-recalling dynamics of the quantum Hopfield model. In section 4, we derive the 
macroscopic deterministic flow of the overlap between the neuronal state and one of the built-in 
patterns from the microscopic master equation which describes the stochastic processes in the 
quantum Monte Cairo method for the quantum Hopfield model [2]. The general solution of the 
dynamics is obtained under the so-called static approximation. In the next section 5, we apply 
our general solution to a special case, namely, sequential recalling the built-in two patterns via 
asymmetric Hebb connections. The effect of quantum- mechanical noise is compared with that 
of the conventional thermal noise. The last section is summary. 



2. The Hopfield model 

In this section, we briefly explain the basics of the conventional Hopfield model. Then, we shall 
divide the model into two classes, namely, the Hopfield model put in thermal noises (the model 
is referred to as classical systems) and the same model in the quantum-mechanical noise (the 
model is referred to as quantum systems). In following, we define each of the models explicitly. 

2.1. The classical system 

Let us consider the network having iV-neurons. Each neuron Si takes two states, namely, Si = +1 
(fire) and S% = —1 (stationary). Neuronal states are given by the set of variables Si, that is, 
S = (Si, ■ ■ ■ , Sn), Si G {+1, —1}- Each neuron is located on a complete graph, namely, graph 
topology of the network is 'fully-connected'. The synaptic connection between arbitrary two 
neurons, say, Si and Sj is defined by the following Hebb rule: 

\x,v 

where £^ = , £/v),£f £ {+1> — 1} denote the embedded patterns and each of them is 

specified by a label fj, = 1, • • • ,P. A^ denotes (P x P)-size matrix and P stands for the number 
of built-in patterns. We should keep in mind that there exists an energy function (a Lyapunov 
function) in the system if the matrix A^ v is symmetric. 

Then, the output of the neuron i, that is, Si is determined by the sign of the local field hi as 

p P 
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where A^ v and A > v > are elements of p x p, (P — p) x (P — p)-size matrices, respectively. We also 
defined the overlap (the direction cosine) between the state of neurons S and one of the built-in 
patterns ^ by 

= ^(s-n = ^E^- (3) 

i 

Here we should notice that the Hamiltonian of the system is given by — ^ hi Si. The first term 
appearing in the left hand side of equation ([2]) is a contribution from p ~ 0(1) what we call 
'condensed patterns', whereas the second term stands for the so-called 'cross-talk noise'. In this 
paper, we shall concentrate ourselves to the case in which the second term is negligibly small 
in comparison with the first term, namely, the case of P = p ~ 0(1). In this sense, we can say 
that the network is 'far from its saturation'. 

2.2. The quantum system 

To extend the classical system to the quantum- mechanical variant, we rewrite the local field hi 
as follows. 

4h= Eerv(^E^f) w 

where erf (i = 1, ■ ■ ■ , N) stands for the z-component of the Pauli matrix. Thus, the Hamiltonian 
Hq = — ^2i 4>i&i is a diagonalized (2^ x 2 N )-size matrix and the lowest eigenvalue is identical 
to the ground state of the classical Hamiltonian — (piSi (Si is an eigenvalue of the matrix 



Then, we introduce quantum-mechanical noise into the Hopfield neural network by adding 
the transverse field to the Hamiltonian as follows. 

N 

H = H -Tj2"i (5) 

i=i 

where erf is the x-component of the Pauli matrix and transitions between eigenvectors of the 
classical Hamiltonian Hq are induced due to the off-diagonal elements of the matrix H for r / 0. 
In this paper, we mainly consider the system described by (J5j) . 

3. Quantum Monte Carlo method 

The dynamics of the quantum model © follows Schrodinger equation. Thus, we should solve it 
or investigate the time dependence of the state \ip(t)) by using the time-evolutionary operator 
e -iHAt/h dgfingd f or infinitesimal time At as 

m + At)) = e- iHAt / h m))- (6) 

However, even if we carry it out numerically, it is very hard for us to do it with reliable precision 
because (2^ x 2 Ar )-size Hamilton matrix becomes huge for the number of neurons N S> 1 as in a 
realistic brain. Hence, here we use the quantum Monte Carlo method to simulate the quantum 
system in our personal computer and consider the stochastic processes of Glauber-type to discuss 
the pattern-recalling dynamics of the quantum Hopfield model. 

3.1. The Suzuki- Trotter decomposition 

The difficulty to carry out algebraic calculations in the model system is due to the non- 
commutation operators appearing in the Hamiltonian namely, Ho, Hi = — r^erf. Thus, 
we use the following Suzuki- Trotter decomposition [13] in order to deal with the system as a 
classical spin system. 

^ ,H " + '" , - 1 &K exp (^) exp (^)) M (7) 

where f3 denotes the 'inverse temperature' and M is the number of the Trotter slices, for which 
the limit M — > oo should be taken. Thus, one can deal with d-dimensional quantum system as 
the corresponding (d + l)-dimensional classical system. 

4. Derivation of the deterministic flows 

In the previous section, we mentioned that we should simulate the quantum Hopfield model 
by means of the quantum Monte Carlo method to reveal the quantum neuro-dynamics through 
the time-dependence of the macroscopic quantities such as the overlap. However, in general, it 
is also very difficult to simulate the quantum-mechanical properties at the ground state by a 
personal computer even for finite size systems (N,M < oo). 

With this fact in mind, in this section, we attempt to derive the macroscopic flow equations 
from the microscopic master equation for the classical system regarded as the quantum system 
in terms of the Suzuki- Trotter decomposition. This approach is efficiently possible because the 
Hopfield model is a fully-connected mean-field model such as the Sherrington-Kirkpatrick model 
[15] for spin glasses and its equilibrium properties are completely determined by several order 
parameters. 



4-1- The master equation 

After the Suzuki- Trotter decomposition (|7|), we obtain the local field for the neuron i located 
on the fc-th Trotter slice as follows. 

P<fH{tT k :oi(k±l)) = ^E^vl^E^iWf +f + + (8) 

f*>" [ j J 

where parameter i? is related to the amplitude of the transverse field (the strength of the 
quantum-mechanical noise) T by 

B = ilogcothf^). (9) 



2 ° \M, 

In the classical limit r — > 0, the parameter B goes to infinity. For the symmetric matrix A^ u , 
the Hamiltonian (scaled by /3) of the system is given by — £^ /^(cr^. : <r(fc =L l))<jj(/c). 

Then, the transition probability which specifies the Glauber dynamics of the system is given 
by Wi(<Tfc) = (1/2) [1 — ai(k) tanh(/3(/)j(cr fc : a(k ± 1)))]. More explicitly, Wi(ak) denotes the 
probability that an arbitrary neuron o~i(k) changes its state as o~i{k) — > —o~i(k) within the time 
unit. Therefore, the probability that the neuron Uj(fc) takes +1 is obtained by setting Oi(k) = — 1 
in the above Wi{cTk) an d we immediately find <Ji{k) = o~i(k — 1) = ai(k + 1) with probability 1 
in the limit of B — > oo which implies the classical limit r — > 0. 

Hence, the probability that a microscopic state including the M- Trotter slices {<Jk} 
(7 1 . • • • , cjM^i^k = (o-\(k), • • • , a^(k)) obeys the following master equation: 



A (I \\ M N 

= ^^[ft^KJKtFf'K))-^^^^)] (io) 
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where F^ k \-) denotes a single spin flip operator for neuron i on the Trotter slice k as 
a"i(fe) — > —ai{k). When we pick up the overlap between neuronal state and one of the 
built-in patterns namely, 

i 

as a relevant macroscopic quantity, the joint distribution of the set of the overlaps {mi, ■ • • , tum} 
at time t is written in terms of the probability for realizations of microscopic states Pt{{&k}) at 
the same time t as 

M 

PtW, ...,m v M )=J2 MWk}) II S ( m k - (12) 

{CT fc } fc=l 

where we defined the sums by 

£(•••) - E-E(-), E---)- E ••• E (•••)• d3) 

{<r fe } a- 1 <r M tr h o-i(fe)=±l cr N (k)=±l 



Taking the derivative of equation f)12[) with respect to t and substituting ()10p into the result, we 



have the following differential equations for the joint distribution 
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where we introduced several notations 



m) - g^P^ mg + f - 1) + f + 1) 



(14) 



(15) 



(16) 



for simplicity. 

Here we should notice that if the local field f3cf>(k) is independent of the microscopic variable 
{cr k }, one can get around the complicated expectation of the quantity tanh[/30(A;)] over the 
time-dependent Gibbs measurement which is defined in the sub-shell: n&:^( m fc — m k ( cr k))- As 
the result, only procedure we should carry out to get the deterministic flow is to calculate the 
data average (the average over the built-in patterns). However, unfortunately, we clearly find 
from equation (|16p that the local field depends on the {cr k }. To overcome the difficulty and to 
carry out the calculation, we assume that the probability Pt({&k}) °f realizations for microscopic 
states during the dynamics is independent of t, namely, 

pt({cr k }) = p({a k }). (17) 

Then, our average over the time-dependent Gibbs measurement in the sub-shell is rewritten as 

£ { <x fc} PtiWkW tanh[/30(fc)] U k ,i 5 « " "»*(**)) 



T,{a k } PtiWk}) Uk 6 ( m k ~ 
x 5(a(k + 1) - (n(k + l))6(a(k -l)-<n(k- 1)) 
= {C tanh[/30(A;)] H 5{a{k + 1) - a % {k + l))5(aQ 
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(18) 



where (•••)* stands for the average in the sub-shell defined by m k = m k (cr k ) (V^) 

E { a k} p(Wk})(- ■ • ) Uk *K - KK)) 

( " ' '* ~ £ { <x fc} P(Wk}) Uk *K - ml{a k )) 

If we notice that the Gibbs measurement in the sub-shell is rewritten as 

M 



Yl P({ a k})YlS(ml -m v k {a k )) = tr {(j} exp 

{CT fe } k 
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(19) 



(20) 



(t r { CT }(- • • ) = Uk Eo- fc (' ' ' )). and the quantity 

tanh /30(/c = — =^ \o,n\ ITS] — ( 21 

is independent of cr(fc), the average appearing in (fTBj) leads to 

tr W e{i7 E,=i *(0> exp[M*M*0] 



(£" tanh[/30(fc)] J] £(cr(A; ± 1) - ± 1))), 



tr M exp[/3^(A;)cr(A:)] 
£»S ( 22 ) 



in the limit of M —¥ oo. This is nothing but a path integral for the effective single neuron 
problem in which the neuron updates its state along the imaginary time axis: trr CT i(---) = 
E<x(i)=±i • • • Eo-(M)=±i(' • • ) with weights exp[f34>(k)a(k)], (k = !,-■■ ,M). 
Then, the differential equation (|14p leads to 



dP t{ m^.,m M ) = ^_i_ {m ^ (m?) ..., K ,... ;</)} 



- E^{ p ^i'--- ^m) /^[ewrnsj. (23) 

In order to derive the compact form of the differential equations with respect to the overlaps, we 
substitute Pt{m\, • • • ,m M ) = flfeli ^( m k ~ m fc(*)) m t° the above ([23]) and multiplying m\ by 
both sides of the equation and carrying out the integral with respect to dm\ ■ ■ ■ dm M by part, 
we have for I = 1 , • • • , M as 

/oo 
DindCCi^Xl (24) 
-oo 



dm\ 
dt 



Here we should notice that the path integral £, u (o~/p ath depends on the embedded patterns £, v . 
In the next subsection, we carry out the quenched average explicitly under the so-called static 
approximation. 

Jf..2. Static approximation 

In order to obtain the final form of the deterministic flow, we assume that macroscopic quantities 
such as the overlap are independent of the Trotter slices k during the dynamics. Namely, we 
must use the so-called static approximation: 

m% = m u (V k ). (25) 

Under the static approximation, let us use the following inverse process of the Suzuki- Trotter 
decomposition (|7j): 



lim Zm = tr exp 

M-^oo 



(26) 



Zm = tr^exp 
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^2<r(k) + B^a{k)a{k + 1) 



(27) 



In our previous study [14] . we numerically checked the validity of static approximation by 
computer simulations and found that the approximation is successfully valid for the pure- 
ferromagnetic system but it is deviated from the good approximation for the disordered systems. 
The validity of the static approximation was recently argued by Takahashi and Matsuda |16j 
from the different perspective. 

Then, one can calculate the path integral immediately as 



Inserting this result into (|24p . we obtain 



tanh P 



(28) 



dm v 
dt 
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(E^V^) 2 + r 2 



tanh (3 



where we should bear in mind that the empirical distribution in 
built-in pattern distribution V(£ u ) as 



J2^ A ^ m "j + r2 ( 29 ) 

was replaced by the 
(30) 



in the limit of N — > oo and the average is now carried out explicitly as 



J {■■■) = J p(Odr(. 



E 



(31) 



Equation (|29p is a general solution for the problem in this paper. 



4-3. The classical and zero-temperature limits 

It is easy for us to take the classical limit r — > in the result (|29|) . Actually, we have immediately 



dm v 
dt 



rtanhf^e^VmM 



(32) 



The above equation is identical to the result by Coolen and Ruijgrok [T7] who considered the 
retrieval process of the conventional Hopfield model under thermal noise. 
We can also take the zero-temperature limit (3 — > oo in ()29p as 



dm v 



-m 



(33) 



Thus, the equation (|29p including the above two limiting cases is our general solution for the 
neuro-dynamics of the quantum Hopfield model in which 0(1) patterns are embedded. Thus, 
we can discuss any kind of situations for such pattern-recalling processes and the solution is 
always derived from (|29p explicitly. 



5. Limit cycle solution for asymmetric connections 

In this section, we discuss a special case of the general solution (|29j) . Namely, we investigate 
the pattern-recalling processes of the quantum Hopfield model with asymmetric connections 



5.1. Result for two-patterns 

Let us consider the case in which just only two patterns are embedded via the following matrix: 



A 



1 -1 
1 1 



(34) 



Then, from the general solution the differential equations with respect to the two overlaps 
mi and m 2 are written as 



drrii 
~~dT 

dni2 
~~dT 



-mi 



-m 2 + 



mi 



m 2 



V(2m!) 2 +r 2 V(2m 2 ) 2 +r 2 
mi m 2 
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V(2m!) 2 +r 2 v / (2m 2 ) 2 +r 2 



In Figure [IJ we show the time evolutions of the overlaps mi and m 2 for the case of the 
amplitude T = 0.01. From this figure, we clearly find that the neuronal state evolves as 
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Figure 1. Time evolutions of mi and mi for the case of Y = 0.01. 

A— > B —> A B — > A — > B — > ■ ■ ■ (A, B denote the 'mirror images' of A and B, respectively), 
namely, the network behaves as a limit cycle. 

To compare the effects of thermal and quantum noises on the pattern-recalling processes, 
we plot the trajectories mi-m 2 for (T = /3 -1 ,r) = (0, 0.01), (0.01, 0) (left panel), (T,T) = 
(0, 0.8), (0.8, 0) (right panel) in Figured From these panels, we find that the limit cycles are 
getting collapsed as the strength of the noise level is increasing for both thermal and quantum- 
mechanical noises, and eventually the trajectories shrink to the origin (mi,m 2 ) = (0,0) in the 
limit of T,T -> oo. 

6. Summary 

In this paper, we considered the stochastic process of quantum Monte Carlo method applied 
for the quantum Hopfield model and investigated the quantum neuro-dynamics through the 
differential equations with respect to the macroscopic quantities such as the overlap. By using 
the present approach, one can evaluate the 'inhomogeneous' Markovian stochastic process of 
quantum Monte Carlo method (in which amplitude T is time-dependent |18} I19j ) such as 




quantum annealing (2DJ ED E2] [23], [2H ES] . In the next step of the present study, we are planning 
to extend this formulation to the probabilistic information processing described by spin glasses 
including a peculiar type of antiferromagnet [26J . 
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